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SYSTEM AND METHOD FOR EMBEDDING A WATERMARK SIGNAL 
THAT CONTAINS MESSAGE DATA IN A DIGITAL IMAGE 

FIELD OF THE INVENTION 

5 The invention relates generally to the field of digital image 

processing, and in particular to a method for embedding watermarks in digital 
images. 

BACKGROUND OF THE INVENTION 

10 Digital watermarking refers to the embedding of a message in an 

image or image sequence for such purposes as establishing ownership, tracking 
the origin of the data, preventing unauthorized copying, or conveying additional 
information (meta-data) about the content. Watermarking has potential uses in a 
wide range of products, including digital still and video cameras, printers and 

15 other hardcopy output devices, and content delivery services (e.g., Internet-based 
photo finishing) . 

Numerous image watermarking methods have been described in the 
prior art, including both patents and the technical literature. Many of these 
methods are described in review papers such as: Hartung and Kutter, Multimedia 

20 Watermarking Techniques, Proc. IEEE, 87(7), pp. 1 079-1 107 (1999), and 

Wolfgang et al., Perceptual Watermarks for Digital Images and Video" Proc. 
IEEE, 87(7), pp. 1 108-1 126 (1999). 

A basic distinction between various methods is whether the 
watermark is applied in the spatial domain or the frequency domain. In either 

25 approach, many techniques use a pseudo-random (PN) sequence in the watermark 
generation and extraction processes. The PN sequence serves as a carrier signal, 
which is modulated by the original message data, resulting in dispersed message 
data (i.e., the watermark) that is distributed across a number of pixels in the image. 
A secret key (i.e., seed value) is commonly used in generating the PN sequence, 

30 and knowledge of the key is required to extract the watermark and the associated 
original message data. 
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The use of a PN sequence in the watermarking process typically 
results in a watermark signal that has similar visual characteristics to a random 
noise field. While noise is an inherent component of digital images because of 
sensor noise (whether originating from film grain when film is scanned or from 
5 sensor noise in a digital camera), it is generally desirable to minimize the 
additional noise that is introduced by the watermarking process. This is 
accomplished by reducing the amplitude of the watermark signal so that it is 
below the threshold of perception (i.e. subthreshold). The result is a watermark 
that is visually transparent, i.e. the watermark cannot be perceived by an observer 

1 0 under typical viewing conditions. 

In some applications it may be impossible to provide sufficient 
robustness to the embedded watermark and still meet the goal of visual 
transparency. This is because a low amplitude watermark is more vulnerable to 
removal attacks, where an attempt is made to remove the watermark by using 

15 various types of image processing methods, e.g. lowpass filtering. In such cases, 
it becomes necessary to increase the watermark amplitude, which may result in a 
watermark pattern that is easily detectable (i.e. suprathreshold), and perhaps even 
objectionable, when viewed by an observer. 

There are watermarking techniques that intentionally use 

20 suprathreshold watermarks. Some of these techniques embed watermarks that are 
easily visible to any observer, e.g., a logo that is placed in the corner of a 
television screen to indicate the broadcasting station. These types of watermarks 
are called obvious watermarks. Other suprathreshold watermark techniques are 
more subtle in that the watermark may be obvious to an observer who knows the 

25 nature of the watermark, but it is not obvious to an uninformed observer. An 

example of this latter approach can be found in U.S. Patent No. 5,699,427 issued 
December 16, 1997 to Chow et al. entitled Method to Deter Document and 
Intellectual Property Piracy Through Individualization. This patent teaches a 
method for modifying documents and images in such a way that numerous 

30 variations of the original can be produced, but these variations do not change the 
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overall meaning or usefulness of the documents or images. The variations can 
include changing the spelling of words in a document or the color of objects in an 
image. A limitation of this approach is that the amount of embedded information 
is constrained, and it is also very difficult to embed arbitrary information such as a 
5 time/date stamp. Moreover, the method requires significant manual intervention 
to identify the words, objects, etc. that can be modified without affecting the 
overall meaning or usefulness of the document or image. 

There is a need therefore to have a watermarking technique for 
images that allows the embedding of a high amplitude watermark in such a way 
10 that: 1) the resulting watermark is not objectionable to an observer; 2) arbitrary 
information can be included in the watermark; and 3) manual intervention is not 
required to perform the embedding process. 



SUMMARY OF THE INVENTION 

15 The need is met according to the present invention by providing a 

method for embedding a watermark signal that contains message data in a digital 
image represented as a two-dimensional array of pixel values that includes the 
steps of: providing a dispersed message image having pixel values representative 
of the message data; modifying each pixel value of the dispersed message image 

20 as a function of the corresponding pixel value in the digital image; and combining 
the modified dispersed message image with the digital image to produce a 
watermarked image. 



ADVANTAGES 

25 The present invention has the advantage of making the visual 

characteristics of the watermark look like an expected attribute of an image that is 
produced by a given imaging system. In particular, the present invention 
minimizes the objectionability of the watermark pattern by making its appearance 
similar to the expected noise for the given imaging system. 



30 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a prior art method for embedding a watermark in an 

original image; 

Fig. 2 is a prior art method for extracting a watermark from an 
5 image containing an embedded watermark; 

Fig. 3 is a block diagram that illustrates the embedding of a signal- 
dependent watermark according to the present invention; 

Fig. 4 is an example of noise standard deviation as a function of 
signal level for signal-dependent noise; 
1 0 Fig. 5 is a prior art preferred embodiment for the frequency 

spectrum of a watermark carrier signal; 

Fig. 6 is an example of the frequency spectrum of film grain noise; 
Fig. 7 is an example of a carrier frequency spectrum that is 
modified to simulate the frequency spectrum of film grain noise; and 
1 5 Fig. 8 is an example of the frequency spectrum components that 

represent the carrier support region and the film grain noise support region. 

DETAILED DESCRIPTION OF THE INVENTION 

The present invention is preferably implemented by a programmed 
20 digital computer. The computer can be a general purpose digital computer or a 
special purpose computer for digital image processing. It is within the ordinary 
skill in the programming art to provide a computer program for practicing the 
present invention from the following description of the invention. 

A preferred data embedding technique for use with the present 
25 invention is disclosed in U.S. Patent No. 6,044,156 issued March 28, 2000 to 

Honsinger et al. entitled Method for Generating an Improved Carrier for Use in 
an Image Data Embedding Application. This patent is included in its entirety by 
reference. Referring to Fig. 1, in this technique, an original two-dimensional 
digital image 10, I(x,y) , is processed to produce a watermarked image 12, 
30 I'(x,y) . A two-dimensional message 14, M(x,y) , represents the data to be 
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embedded in the original image 10. In its most general form, the message 14 is an 
image, and it can represent an icon 16 (e.g., a trademark), or it can represent the 
bits 18 in a binary message. In the latter case, the on and off states of the bits are 
represented as plus and minus ones (more specifically, positive and negative delta 
5 functions), which are placed in predefined and unique locations across the 

message image. Examples of iconic message data are trademarks, corporate logos 
or other arbitrary images. In order to minimize the message energy, an edge map 
of the icon is often used instead of the actual icon. Examples of binary message 
data are 32-bit representations of URL's, and copyright ID codes, or 
10 authentication information. 

As shown in Fig. 1, the fundamental steps for embedding message 
data in an original image with this method are: 

1. Anxn message image 14, M(x,y) , is generated from the message data; 

2. The message image 14 is circularly convolved 20 with anxn carrier image 
15 22, C{x,y) to produce anxn dispersed message image 24. The carrier 

image may be produced using a secure key 26 as is known in the prior art; 

3 . The dispersed message image 24 is scaled 28 in amplitude using a 
multiplicative factor a ; and 

4. The scaled dispersed message image 30 is added to the original image 10 as 
20 contiguous nxn tiles to form a watermarked image 12, I'(x,y) . 

The carrier image 22 is derived from a PN sequence, and its 
properties can be modified to achieve certain performance goals, such as 
robustness to removal attacks. The scaling factor a is an arbitrary constant that is 
generally chosen to make the embedded energy simultaneously invisible and 

25 robust to common processing. Typically, the size of the dispersed message image 
24 is chosen to be smaller than the size of original image 10, and the tiling process 
allows the scaled dispersed message image 30 to be repetitively embedded over 
the extent of the original image 10. The repetitive structure provides robustness to 
the watermark when image processing operations (such as cropping, compression, 

30 lowpass filtering, etc.) are applied to the watermarked image. Other watermarking 
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techniques use different methods for embedding the message data, but the 
repetitive nature of the embedding process is a common aspect because of this 
improved robustness. 

This embedding process for each tile can be described 
5 mathematically as: 

I'i (x, y) = a[M(x, y) * C(x, y)] + 1, (x, y) , (1 ) 

where the symbol * represents circular convolution and the subscript i indicates 
1 0 the f 1 tile (7=1 ,...,N). From Fourier theory, spatial convolution is equivalent in 
the frequency domain to adding phase while multiplying magnitudes. Therefore, 
the effect of convolving the message image 14 with the carrier image 22 is to 
distribute the message energy in accordance with the phase of the carrier image 
and to modulate the amplitude spectrum of the message image with the amplitude 
1 5 spectrum of the carrier image. If the message image were a single delta function, 
S(x, y) , and the carrier image had random phase and uniform Fourier magnitude, 
the effect of convolving with the carrier image would be to distribute the delta 
function over space. Similarly, the effect of convolving a message image with a 
random phase carrier image is to spatially disperse the message energy. 
20 As shown in Fig. 2, the process as described by Honsinger et al. for 

extracting the message data from a watermarked image 12 consists of the 
following fundamental steps: 

1 . Contiguous n x n tiles 12' are formed from the watermarked image 12, 

/W); 

25 2. The tiles 12' are averaged 32 across each spatial location (x,y) to form an 
averaged tile 34; 

3. The averaged tile 34 is circularly correlated 36 with the n x n carrier image 22 
C(x,y) to produce an extracted n x n message image 14', M'(x,y) ; and 

4. The message data is recovered from the extracted message image 14'. 

30 The averaging 32 of the individual tiles 12' improves the extraction of 

the message image because the dispersed message image in each tile will add 
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constructively (since it is the same in each tile), while the corresponding original 
image content in each tile will add destructively (since it is typically different in 
each tile). 

This watermark extraction process can be described mathematically 



M'(x,y) = 



1 N 



®C(x,y) 



i- X (a[M(x, y) * C(x, y)] + 1; (x, y)) 



5C(x,y) 



(2) 



= a[M(x, y) * C(x, y)] ® C(x, y) - 



1 N 



5C(x,y) 



where the symbol ® represents circular correlation. Correlation is similar to 
convolution in that Fourier magnitudes also multiply. In correlation, however, 
phase subtracts. Therefore, the phase of the carrier image subtracts when the 
watermarked image is correlated with the carrier image, thus leaving the message 
image. Indeed, if we assume that the carrier image is designed to have uniform 
Fourier amplitude, then the process of correlation of the carrier image on the 
watermarked image in Eq. 2, can be reduced to: 

M'(x, y) = oM(x, y) + noise. (3) 

That is, the extracted message image is a scaled version of the 
original message image plus noise due to the cross correlation of the summed 
original image tiles with the carrier image. 

In the method of Honsinger et al., the amplitude of the watermark 
is adjusted by changing the scaling factor a . However, the amplitude is always 
adjusted by the same amount throughout the entire image. Referring to Fig. 3, in 
the present invention, the amplitude of the dispersed message image 24 is scaled 
28' at each spatial location (x, y) in each tile i to produce a scaled dispersed 
message image 30'. With this modification, the embedding equation becomes: 



l[ (x, y) = oq (x, y)[M(x, y) * C(x, y)] + 1, (x, y) , (4) 



where a x (x, y) is a signal-dependent scaling factor that varies from pixel to pixel 
5 within a given tile and from tile to tile. Specifically, 

ar i (x,y) = f(I i (x,y)), (5) 

where f^x.y)) indicates that the dispersed message image amplitude scaling 
10 factor is a function of the original image pixel value /. at each spatial location 
(x,y). 

As an illustration of signal-dependent noise and the resulting effect 
on the watermark amplitude scaling factor, we consider a system that uses a 
conventional color negative photographic film as the original capture medium. 

15 After exposure and development, the film is digitized by scanning with a digital 

scanner. Both film grain and scanner noise are introduced during this process, and 
we can determine the overall system noise as a function of the signal level (e.g., 
the signal level could be the codevalue that corresponds to a particular density in 
the original negative). The characterization of the system noise is typically 

20 performed by measuring the standard deviation, a , of an image region containing 
a uniform signal level, and repeating this measurement at different signal levels. 
A complete description of methods for characterizing noise in film-based systems 
can be found in U.S. Patent No. 5,641,596 issued June 24, 1997 to Gray et al. 
entitled Adjusting Film Grain Properties in Digital Images. 

25 An example of the noise standard deviation as a function of signal 

level is shown in Fig. 4, where all values have been specified in terms of 8-bit 
codevalues. In this figure, three different single-dependent relationships are 
shown: one for the red color channel 40, one for the green channel 42, and one for 
the blue channel 44. Regardless of the color channel, it can be seen the noise 

30 standard deviation first increases slightly, then decreases, and finally increases 
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again as the signal level is increased. This behavior is the result of the 
combination of the film grain noise increasing and then decreasing as the signal 
level increases, while the scanner noise starts low and then increases with 
increasing signal level. 

To apply the signal-dependent characterization of the system noise 
as shown in Fig. 4, the scaling factor is made proportional to the noise standard 
deviation that corresponds to the signal level at each location, i.e. 

a i (x,y) = ko-(I i (x,y)), (6) 

where A; is a constant. We can choose k so that the amplitude of the resulting 
watermark signal matches the overall system noise, or it may advantageous to 
increase or decrease k to provide more or less noise, respectively, in the 
watermarked image. The mapping of the image values Ij (x, y) to a noise 
standard deviation cr can be performed using a lookup table or a mathematical 
equation. Such mappings are described in the aforementioned patent by Gray et 
al. To better mimic the overall system noise characteristics, it is also desirable to 
use separate mappings for the red, green, and blue color channels as shown in Fig. 
4. For this example, the result is that the watermarked image will have more noise 
in the blue channel than the red and green channels. This is a common 
characteristic of film/scanner systems. 

There are watermarking techniques in the prior art that also adjust 
the watermark amplitude based upon local signal content in the original image. 
Descriptions of such techniques can be found, for example, in the aforementioned 
review paper by Wolfgang et al; in a paper by Kundar et al. entitled A Robust 
Digital Image Watermarking Method Using Wavelet-Based Fusion, Proc. IEEE 
Int. Conf. Image Processing (ICIP), Vol. I, pp. 544-547, 1997; and in U.S. Patent 
No. 6,031,914 issued February 29, 2000 to Tewfik et al. entitled Method and 
Apparatus for Embedding Data, Including Watermarks, in Human Perceptible 
Images. There are two important distinctions between these prior art methods and 
the present invention. First, the motivation for locally changing the watermark 
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amplitude in the prior art methods is to take advantage of perceptual masking. 
Masking allows for an increase in the watermark amplitude in image regions 
where there is significant image content, e.g. edge regions or texture regions, for 
the purpose of increasing the watermark robustness. The image content masks the 
5 increased amplitude so that the watermark is still below the threshold of 
perception. In comparison, the present invention does not use masking to 
maintain imperceptibility of the watermark. Instead, it uses the signal-dependent 
nature of imaging systems to adjust the watermark amplitude so as to provide a 
visible watermark signal that is more natural in appearance. Of course, increasing 

1 0 the watermark amplitude in certain areas because of signal-dependent noise may 
also take advantage of masking to some extent, thus lowering the visibility of the 
signal-dependent watermark. However, the present invention is not motivated by 
the desire to keep the watermark below the threshold of perception. To the 
contrary, the present invention specifically allows watermark patterns to be 

1 5 perceptible, but reduces the objectionability of the visible patterns by making the 
watermark have visual characteristics that are consistent with the characteristics of 
the imaging system. As a side benefit, the signal-dependent nature of the 
watermark may also improve the watermark robustness by allowing overall larger 
amplitudes, depending on the distribution of image values (which correspondingly 

20 determine the signal-dependent scaling factor). 

The second distinction between the prior art and the present 
invention is that the adjustment of the watermark amplitude is based upon 
different image attributes. In the prior art masking techniques, the amplitude 
adjustment is performed over a local region (e.g., an 8 x 8 block of pixels), and the 

25 variance of the signal over the block is used to control watermark amplitude. In 
comparison, the amplitude adjustment in the present invention is performed 
separately for each individual pixel in the image, and the pixel value (not a local 
variance) is used to control the scaling factor. 
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The adjustment of the watermark amplitude at each pixel location 
affects the estimated message image that is obtained during the extraction process. 
We can rewrite Eq. 2 to include the signal-dependent scaling factor a { (x, y) : 



M'(x,y) = 



1 N 

^iUx,y) 



3>C(x,y) 



-|-f>i (*. Y)[M(x, y) * C(x, y)] + 1, (x, y)) 



— 2«i (x, Y) [M(x, y) * C(x, y)] ® C(x, y) h 



5>C(x,y) 



1 N 

-5>(x,y) 



<>C(x,y) 
(7) 



As before, if we assume that the carrier is designed to have uniform 
Fourier amplitude, then the process of correlation of the carrier on the embedded 
10 image in Eq. 7, can be reduced to: 



M'(x,y) = 



1 N 



=1 



M(x, y) + noise 



(8) 



= a (x, y)M(x, y) + noise 



where a (x, y) is the average scaling factor across all tiles at each spatial location 
1 5 (x, y). If a sufficiently large number of tiles are averaged, it is expected that 

a(x,y) would be approximately the same for every spatial location (x, y), i.e., 



M'(x, y) « 5M(x, y) + noise. 



(9) 



20 This is the same relationship that was obtained for the case of a 

constant scaling factor, and thus the signal-dependent watermark process does not 
significantly affect the extraction process if a large number of tiles are available. 

Even if only a few tiles are available, the resulting a(x, y) will 
have mainly low frequency variations. In the method by Honsinger et al., the 



-12- 



determination of the message data from the estimated message image M'(x,y) is 
done on a local basis, and the low frequency variations in M'(x, y) due to 
variations in a(x,y) will not greatly affect the extraction process. However, in 
some cases, it may be advantageous to undo the variations in M'(x, y) that have 
5 been introduced by a(x, y) . This can never be done perfectly since we only have 
access to the watermarked image I\x,y) , not the original image I(x,y) , during 
the extraction process. Still, I'{x,y) provides an estimate of I(x,y) , and we can 
use the signal dependent function f (I'(x, y)) to estimate a x (x, y) for each pixel in 
each tile. Since the watermark signal is similar to a noise field, it is also possible 

10 to filter I'(x,y) to provide a better estimate of I(x,y) . Any number of well- 
known noise filtering methods can be used for this purpose, e.g., lowpass linear 
smoothing filters or nonlinear filters such as median filters. Regardless of the 
method that is used to estimate I(x, y) , the resulting estimate can be evaluated 
with the signal dependent function to produce an estimate of the watermark 

15 scaling factor at each spatial location in each tile, i.e., 

« i '(x,y) = f(Ii(x,y)). (10) 



This estimate can then be used to normalize each pixel of each tile of the 
20 watermarked image prior to the averaging of the tiles: 



M'(x,y) = 



1 y a t (x,y) 



=i&i (x,y) 



M(x, y) + noise 



(11) 



w M(x,y) + noise 



In addition to applying signal dependencies to the carrier 
25 amplitude, it may also be desirable to shape the carrier frequency spectrum 
(specifically, the Fourier amplitude spectrum) to make the embedded signal 
appear more like film grain. In U. S. Patent 6,044,156, referenced above, the 
preferred carrier possesses a flat frequency spectrum except near the DC 
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frequency. Referring to Fig. 5, a flat frequency amplitude spectrum 46 is 
preferred to ensure that the message image is reconstructed with the highest 
fidelity. However, as described in the Honsinger patent, the carrier spectrum is 
shaped to include a ramp 48 in Fourier amplitude from DC frequency in order to 
5 minimize the impact of the cross-correlation of the carrier with the image data. 

In contrast to the flat spectrum recommended by Honsinger et al., 
the shape of the Fourier amplitude spectrum of film grain noise (as well as many 
other imaging system noise sources) generally is a decreasing function with 
frequency. Fig. 6 depicts an example of a typical Fourier amplitude spectrum 50 

10 for film grain. U.S. Patent 5,641,596, referenced above, describes methods for 
characterizing the spatial correlation coefficients of film grain, which is entirely 
equivalent to characterizing the Fourier amplitude spectrum. As shown in Fig. 7, 
according to one aspect of the present invention, the carrier spectrum maintains 
the ramp 48 in Fourier amplitude, but the remaining carrier spectrum 50' is shaped 

15 to the same form as that of film grain. Because the carrier amplitude spectrum 
decreases with frequency in the region that was preferably flat according to 
Honsinger, the impact of this shaping is to reduce the information carrying 
capacity of the embedding algorithm. However, given that the film grain noise 
can be a preferred visual attribute, increasing the amplitude (or, equivalently, 

20 increasing the visibility) of the watermark pattern can compensate for the loss of 
information carrying capacity. A drawback of this embodiment is the inclusion of 
the ramp region in the carrier spectrum does not completely simulate the 
appearance of film grain noise. A solution to this problem is to add an additional 
noise component (independent of the watermarking process) to the dispersed 

25 message image spectrum to fill in the low frequency ramp region 52 as shown in 
Fig. 8. This additional noise component is not an integral part of the 
watermarking process, but is included only to provide better visual qualities to the 
watermark pattern. 

In a preferred embodiment of the invention, the carrier image 

30 spectrum is shaped identically to the film grain noise. Fig. 6 depicts the amplitude 
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spectrum of this carrier. This eliminates the need to fill in the ramp region with 
non-information carrying noise data. However, for the reasons discussed above, 
this process may affect extraction performance, because correlation of the 
embedded image with such a carrier will produce a strong cross-correlation of the 
5 carrier with the original image content. This problem may be eliminated by 

defining two carrier images, an embedding carrier image and an extracting carrier 
image. The embedding carrier image is designed using the full frequency 
spectrum shape of film grain 50 as in Fig. 6, but the extracting carrier image is 
filtered to include the ramp 48 at low frequencies as in Fig. 7. As a result, the 

1 0 embedding carrier image contains the extraction carrier image in addition to the 
extra low frequency energy that is needed to model the film grain noise. 
Practically, this causes no performance problems and allows a simpler embedding 
implementation. 

For completeness, we note that the phase spectrum of film grain 

15 noise is of random character. Visually, observers do not perceive or care about the 
local pixel arrangements due to the phase of the noise. They are far more sensitive 
to the effects produced by the amplitude spectrum of the noise. Therefore, the 
phase generation process of the carrier requires no change from that described in 
U. S. Patent 6,044,156. 

20 As mentioned previously, the present invention offers a method for 

minimizing the objectionability of a high amplitude watermark. However, in 
some systems, suprathreshold watermarking may actually improve perceived 
quality. An example of such a system is digital cinema. Digital cinema refers to 
the electronic distribution and display of theatrical movies. Studios and 

25 distributors have a strong need to protect the movie content from unauthorized 

use, and watermarking can assist by establishing ownership and tracing the source 
of stolen content (through the use of hidden date/time/location stamps inserted at 
the time of the movie presentation). To facilitate the distribution of the movie 
content, it is typically compressed by a significant amount using a technique such 

30 as MPEG. The process of compression often removes a large portion of the high 
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frequency content, resulting in a displayed movie without the expected look that 
includes film grain noise. The present invention can be used to add signal- 
dependent noise to the compressed movie prior to display, thus providing a more 
natural look, while also providing the benefit of a watermark signal. 
5 In the preceding discussion, the present invention was used to replace 

film grain noise that had been removed by a compression process, while 
simultaneously providing a watermark signal. The same concept can be extended 
to provide benefits in other systems. For example, it may be advantageous to 
deliberately remove the inherent noise from an image or image sequence (using 

1 0 one of any well-known noise reduction techniques), and then replace the removed 
noise with a watermark signal that has a desired visual appearance. The 
watermark signal may have a visual appearance that is similar to the noise that 
was removed, or it could have completely different appearance (for example, a 
higher or lower noise level, or noise characteristics that mimic a different type of 

1 5 film). Techniques for creating noise fields with the desired characteristics are 
described in the aforementioned patent by Gray et al. The removal of existing 
noise and subsequent replacement by a watermark signal also provides for a 
system where an existing watermark pattern (which typically has the appearance 
of a noise field) can be effectively removed and then a new watermark pattern 

20 (perhaps containing different information than the original watermark or a 

combination of information from the original watermark and new information) is 
inserted. In a conventional system, a new watermark would be added directly to 
the image containing the original watermark, thus elevating the overall noise level 
due the addition of two watermark patterns. By effectively removing the first 

25 watermark pattern prior to the insertion of the new watermark pattern, the overall 
noise of the twice-watermarked image is kept to a desired level. 

While the invention has been discussed in terms of the watermarking 
process as described by Honsinger et al., it is obvious how the same method can 
be applied to any spatial domain watermarking process that uses a random noise 

30 carrier in the watermarking process. Some spatial domain watermarking processes 
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use more than one carrier within a single image, where the resulting watermark 
pattern is the sum of the carriers after modulation by the message information. 
Signal-dependent scaling of the watermark pattern can also be performed for these 
types of watermarking methods. The invention can also be used for some types of 
5 frequency domain watermarking methods that use a PN sequence to produce a 
watermark pattern that has the visual characteristics of random noise. However, 
most frequency domain methods use frequency decompositions over local regions 
(e.g., 8x8 blocks, and it is not possible to adjust the watermark amplitude at each 
pixel location. Still, signal-dependent adjustment of the watermark can be 

1 0 performed using the average signal value within the local region, and this process 
is fundamentally different that the prior art methods that consider masking in 
adjusting the watermark amplitude. 

The invention has been described in detail with particular reference to 
certain preferred embodiments thereof, but it will be understood that variations 

15 and modifications can be effected within the spirit and scope of the invention. 
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PARTS LIST 
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watermarked image 


12' 


contiguous tiles from watermarked image 
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dispersed message image 
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scale dispersed message image step 
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scale dispersed message image step 
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scaled dispersed message image 
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circular correlation step 
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red channel noise standard deviation 
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green channel noise standard deviation 
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blue channel noise standard deviation 
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flat frequency amplitude spectrum 
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ramp in frequency amplitude spectrum 


50 


film grain Fourier amplitude spectrum 
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remaining carrier spectrum 
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low frequency ramp region 



